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SUMMARY 


Computerized  assessment  promises  to  yield  scores  that  Indicate  how  quickly  Individuals  think, 
solve  problems,  make  decisions,  or  more  generally,  process  Information.  There  Is  a  question, 
however,  of  how  many  processing  speed  scores  are  necessary  to  adequately  characterize  an 
Individual's  capabilities.  One  possibility  Is  that  some  people  think  faster  than  others  on  all 
kinds  of  tasks.  An  alternative  Is  that  some  are  faster  than  others  on  certain  tasks  but  slower 
on  different  tasks.  The  purpose  of  this  effort  was  to  review  three  studies  conducted  as  part  of 
the  Learning  Abilities  Measurement  Program  (Project  LAMP)  that  collected  data  pertaining  to  this 
general  Issue  of  the  dimensionality  of  processing  speed.  In  three  separate  studies,  large  groups 
of  Air  Force  basic  trainees  (N  »  S08,  178,  710,  respectively)  were  administered  a  wide  variety  of 
computerized  tasks  designed  to  tap  verbal,  quantitative,  reasoning,  decision,  classification  and 
choice  skills.  Various  multivariate  analysis  techniques  were  applied  to  the  response  time  data 
from  these  tasks  In  order  to  determine  whether  a  single  speed  factor  could  account  for 
subject-to-subject  variability  or  whether  multiple  speed  factors  were  required.  In  the  first 
study,  the  data  could  roughly  be  accounted  for  by  a  general  speed  factor,  but  a  much  better 
account  could  be  made  If  separate  reasoning  speed,  verbal  speed,  and  quantitative  speed  factors 
were  posited.  Similarly,  In  the  second  and  third  studies,  a  general  speed  factor  was  found,  but 
the  data  could  be  more  easily  accommodated  by  positing  additional  factors,  such  as  perceptual 
processing  speed  and  memory  search  speed.  These  studies  represent  an  Important  first  step  in 
determining  the  number  and  nature  of  Information  processing  speed  factors.  Further  basic 
research  Is  necessary  tc  develop  a  theory-based  taxonomy  of  Information  processing  speed 
variables  before  assessment  applications  can  oe  pursued  systematical ly.  Nevertheless, 
exploratory  application  efforts  might  benefit  from  a  consideration  of  the  kinds  of  processing 
speed  dimensions  discussed  In  this  paper. 
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PREFACE 


This  technical  paper,  based  on  a  symposium  presentation  at  the  92nd  Annual 
Convention  of  the  American  Psychological  Association,  Toronto,  Ontario,  Canada,  24-28 
August  1984,  documents  several  projects  accomplished  for  the  Air  Force  Learning 
Abilities  Measurement  Program  (Project  LAMP).  The  objectives  of  the  program  are  to 
explore  the  feasibility  of  a  model-based  system  of  psychological  assessement. 

The  research  reported  herein  was  conducted  at  the  Manpower  and  Personnel  Division 
of  the  Air  Force  Human  Resources  Laboratory  (AFHRL)  and  was  sponsored  by  the  Air  Force 
Office  of  Scientific  Research.  Data  were  collected  at  the  AFHRL  experimental  testing 
facility  at  Lackland  AFB. 

This  paper  reports  results  from  studies  conducted  In  collaboration  with  Dr.  Raymond 
Chrlstal  and  Dr.  Bill  Tlrre,  of  AFHRL,  who  also  deserve  mention  for  their  comments  on 
this  manuscript.  The  AFHRL  staff  at  Lackland  AFB,  especially  Major  Hector  Acosta,  Dick 
Nlcewonger,  and  Refugio  Gonzalez  provided  significant  assistance  In  all  aspects  of  the 
data  collection.  From  the  0A0  Corporation,  Richard  Walker,  Frank  Rilling,  Janice 
Hereford,  Jenny  Hutchings,  and  Ernest  Pena  provided  Important  help  In  creating  task 
software  and  analyzing  the  data. 
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DIMENSIONS  OF  INFORMATION  PROCESSING  SPEED 


I.  INTRODUCTION 

The  last  few  years  have  seen  a  revival  of  Interest  In  the  Idea  that  general  Information 
processing  speed  Is  related  to  Intelligence.  Some  empirical  evidence  Indicates  that  a  single 
Information  processing  speed  factor  Is  related  to  learning  ability  In  certain  contexts.  For 
example,  memory  retrieval  speed  differentiates  those  who  learn  quickly  while  reading  from  those 
who  do  not,  and  general  reaction  time  differentiates  those  who  efficiently  transfer  new 
Information  to  permanent  memory  storage  from  those  who  are  less  efficient  with  this  process. 
However,  little  research  has  addressed  the  question  of  whether  Information  processing  speed  Is  a 
single,  general  factor  or  whether  there  are  different  varieties  of  processing  speed.  Three 
recent  studies  under  the  Learning  Abilities  Measurement  Program  (Project  LAMP)  have  provided 
converging  evidence  for  multiple  speed  factors,  using  three  distinct  approaches. 

The  first  approach,  whole-task  analysis,  is  the  traditional  methodology  of  differential 
psychology  In  which  examinees  are  administered  a  battery  of  various  cognitive  tasks,  and  factor 
analysis  Is  applied  to  the  matrix  of  correlations  among  performance  Indicators  on  those  tasks  to 
derive  a  small  set  of  factors  that  account  for  the  correlations.  The  second  approach,  stage 
analysis.  Is  the  analysis  of  sequences  of  Information  processing  stage  with  the  goal  being  to 
determine  which  stage  serves  as  the  locus  of  Individual  difference  variation  In  overall  task 
proficiency.  The  third  approach,  coding  analysis.  Is  also  an  Information  processing  approach, 
but  differs  from  the  second  In  being  concerned  less  with  qualitatively  distinct  processing  stages 
than  with  how  various  kinds  of  Information  In  memory  are  accessed  (Slide  1). 


II.  STUDY  1 

In  the  first  study  (based  on  date  from  Kyllonen,  Chrlstal,  S  Tlrre,  1984),  using  a 
microcomputer,  508  Air  Force  basic  trainees  were  administered  a  broad  variety  of  cognitive  tasks 
that  were  designed  to  tap  verbal  (V),  quantitative  (NI,  N2),  Inductive  reasoning  (I),  deductive 
reasoning  (D),  and  memory  span  (M)  abilities.  Slide  2  shows  some  example  Items.  Factor, 
cluster,  and  multi-dimensional  scaling  analyses  of  latency  and  error  data  yielded  separate 
verbal,  quantitative,  and  reasoning  accuracy  factors  and  also  separate  verbal,  quantitative,  and 
reasoning  speed  factors. 

Table  1  and  Slides  3  and  4  show  the  results  of  the  exploratory  factor  analysis  of  the  full 
Intercorrelation  matrix  with  oblique  rotation  of  the  factor  axes.  Both  the  Kalser-Guttman 
criterion  and  the  Screen  test  Indicated  an  eight-factor  solution.  The  factors  were  Interpreted 
as  Reasoning  Level  (Rj),  Reasoning  Speed  (R5),  Verbal/Declarative  knowledge  Level  (Vj), 
Verbal  Retrieval  Speed  (Ys),  Numerical  Level  (Nj),  Numerical/Computation  Speed  (Ns), 
Technical  knowledge  (TK),  and  Clerical  Speed  (IS). 

The  Reasoning  Level  factor  (Rj)  was  loaded  by  the  percent  correct  (PC)  scores  from  tests  In 
the  Inductive  Reasoning,  Deductive  Reasoning,  and  Memory  categories;  all  tests  In  these 
categories  loaded  highest  on  this  factor. 

The  Reasoning  Speed  factor  (Rs)  was  loaded  by  the  latency  scores  from  these  same  tests,  and 
with  the  exception  of  three  verbal  content  tests  which  split  their  variance  between  the  Rs  and  Vs 
factors,  all  loaded  highest  on  the  Rs  factor. 
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SLIDE  I 


DIMENSIONS  OF  PROCESSING  SPEED 

WHOLE-TASK  ANALYSIS 

-  Speed-level  independence? 

-  Arethere  speed  factors  (reasoning,  verbal,  number  speed)? 

STAGE  ANALYSIS 

-  Identify  elementary  operations  with  embedded  tasks 

-  Are  processing  stages  factorially  identifiable  &  independent? 

-  Processing  speed-aptitude  relations 

-  Process-content  distinctions 

CODING  ANALYSIS 

-  Vary  the  decision  rule  for  judging  similarity  using  the  same  task 
(matching  task) 

—  physical  identity 
--  name  identity 
--  category  identity 
--  meaning  identity  (synonyms) 

-  One  factor  or  multi-factor?  (or  simplex?) 

-  Which  underlie  intelligence? 

-  Which  underlie  learning  efficiency? 


SLIDE  2 


EXAMPLE  TEST  ITEMS 


TEST  NAME 

SENTENCE-PICTURE  VERIFICATION 
(Reasoning) 


SYNONYMS 

(Verbal) 


SYMBOLIC  ARITHMETIC 
(Numerical) 


A  -  6/2 


Table  1.  Oblique  Rotated  Factor  Pattern  Matrix  Study  1  ( N  ■  508) 


Hypothe¬ 

sized 

Factor  Test  Name 

R1 

RS 

*1 

v«  "l 

Ns 

TK 

CS  h2 

COMPUTERIZED  TESTS 

I 

Remote  analogies  (PC) 

.37 

.30 

.50 

I 

Number  sets  (PC) 

.43 

.49 

I 

Letter  sets  (PC) 

.48 

.45 

D 

3-term  series  (PC) 

.50 

.35 

0 

Sentence-picture  ab  (PC) 

.40 

.26 

.46 

0 

Trait  levels  (PC) 

.43 

.3: 

M 

Paired  associates  (PC) 

.34 

.46 

M 

Memory  span  (PC) 

.40 

I 

Remote  analogies  (L) 

.40 

.40 

.5  1 

I 

Number  sets  (L) 

.58 

.44 

I 

Letter  sets  (L) 

.62 

.58 

D 

3-term  series  (L) 

.62 

.46 

D 

Sentence-picture  ab  (L) 

.22 

.21 

.25 

D 

Trait  levels  (L) 

.38 

.20 

M 

Paired  associates  (L) 

.40 

.40 

.56 

M 

Memory  span  (L) 

.31 

.30 

V 

Fact  verification  (PC) 

.43 

.24 

V 

Synonym  recognition  (PC) 

.96 

.84 

¥ 

Fact  verification  (L) 

-.20 

.47 

.62 

V 

Synonym  recognition  (L) 

.78 

.79 

■l 

Number  facts  (PC) 

.33 

.13 

"l 

Arithmetic  tracking  (PC) 

.68 

.49 

"1 

Simple  symbolic  (PC)  arithmetic 

.62 

.51 

m2 

Complex  symbolic  (PC)  arithmetic 

.47 

.28 

.5a 

"2 

Sun-Tue  addition  (PC) 

.25 

.45 

.36 

Nl 

Number  facts  (L) 

.29 

.74 

.79 

"1 

Arithmetic  tracking  (L) 

.67 

.64 

"I 

Simple  symbolic  tL)  arithmetic 

.77 

.75 

h2 

Complex  symbolic  (L)  arithmetic 

.45 

.43 

.61 

*2 

Sun-Tue  addition  (L) 

.38 

.39 

ASYAB  TESTS 

0 

Arithmetic  Reasoning 

.38 

.33 

.30 

.64 

0 

Mathematics  knowledge 

.32 

.36 

.27 

.62 

¥ 

Word  Knowledge 

.79 

.74 

¥ 

Paragraph  Comprehension 

.42 

.42 

¥ 

General  Science 

.52 

.44 

.61 

TK 

Auto-Shop  Information 

.77 

.56 

TK 

Mechanical  Comprehension 

.27 

.74 

.70 

TK 

Electronics  Information 

.76 

.63 

CS 

Coding  Speed 

. 

74  .61 

cs 

Numerical  Operations 

. 

79  .63 

Note.  Loadings  <  .25  are  omitted  except 

for  Sentence-picture 

ab  In 

which  two  highest 

loadings  are  included;  matrix  reflected 

for 

posit  ive 

manifold. 

In  parentheses 

following 

computerized  test  name  l  Indicates 

latency 

score,  PC  Indicates  percent  correct  score 

.  Factor 

naees  are  as  follows:  Rj*Reason1ng  Level,  Rs 

•Rea  son  1  ng 

Speed,  Yj 

-Verba  1 

Level, 

Y$*Verba  1 

Speed,  NfNumerlcal  Level,  Ns*Numer1cal 

Speed 

,  TK-Techntcal  Knowledge, 

CS'C lerlcal  Speed, 

h2»Commona 1 ity. 
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SUMMARY 


•  WHOLE  TASK  ANALYSIS 

-  Genera!  level  factor  is  clearly  separate  from  general  speed  factor 

-  Separable  speed  factors  found  in  Reasoning,  Verbal,  and  Number  domains 

-  Gaps  and  mixtures  in  ASVAB 


•  STAGE  ANALYSIS 

-  Processing  stages  can  be  identified  with  factor  analysis 

-  MDS  arrays  tasks  along  two  simplex  dimensions 

-  number  of  processes 

-  differentia!  content 


•  CODING  ANALYSIS 

-  Matching  tasks  (PI,  Nl,  Cl,  Ml)  arranqed  in  2  orthogonal  simplexes 

-  degree  of  perceptual  processing 

-  depth  of  search, 'code  strength 
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IMPLICATIONS  FOR  APTITUDE  TESTING 


•  There  is  more  than  one  processing  speed  parameter 

•  Processing  speed  cannot  be  measured  independent  of  content 

-  general  content:  verbal,  symbolic,  number  (space?) 

-  specific  content:  e.  g. ,  word  valence  vs.  letter  category 

•  Processing  speed  depends  on  qualitative  nature  of  process 

-  perceptual  analysis 

-  memory  search 

•  MDS  of  R  matrix  reveals  subtle  relationships 

-  important  first  step  toward  precise  characterization 
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Slide  11  shows  that  tasks  could  be  arrayed  along  two  siapltiet  !■!••■  n  'iir,  'mi 

the  amount  of  perceptual  processing  (l.e.,  physical  feature  analysis  '  * 3  -  "  »  - .  -  * 

reaction  tlae  to  physical  Identity  Matching.  Dimension  ?  orders  tests  d,  t«»  .  r 

memory  search  required,  fro*  physical  Identity  to  Meaning  identity  Manning.  Mires'"-, 

to  note  that  the  s1*ple  reaction,  choice  reaction,  and  physical  ident't,  »,  r  r,  •,,, 

projections  to  the  $a*e  point  on  D1*ens1on  2,  Indicating  that  all  these  ttsti  1  .  '>»  • ' »  . jm* 

MlnlMal  a*ount  of  *e*ory  search.  Also  Interesting  is  that  the  pr:.  jetn-  •  m  s' 

Identity  Matching  task  on  DlMenslon  1  suggests  that  the  perceptual  processing  itaanis  *  i"i 

task  exceed  those  of  the  other  Identity  Matching  task,  which  of  course  is  m  •  str-  •  wt'  a- 
Intuitive  analysis  of  the  de*ands  of  the  task. 

V.  CONCLUSIONS 

Three  diverse  analysis  paradlgMS  applied  to  data  fro*  three  diverse  sets  of  cognitive  tasks 
provided  converging  evidence  that  Information  processing  speed  Is  *ult id leens tone  1  (Slides  12  and 
13). 


Using  a  whole  task  analysis  approach.  It  was  shown  that  a  general  level  factor  could  be 
clearly  separated  fro*  a  general  speed  factor,  but  More  1*portantly,  that  separate  reasoning, 
verbal,  and  co*putat1on  speed  factors  could  be  Identified.  An  Incidental  benefit  froM  this 
analysis  was  that  IlMltatlons  to  the  current  ASVAB  were  suggested. 

Applying  a  stage  analysis  approach  to  a  second  data  set.  It  was  shown  that  process  and 
content  orderings  of  cognitive  tasks  could  be  produced  with  a  combination  of  factor  analysis  and 
Multidimensional  scaling. 

Applying  a  coding  analysis  approach  to  a  third  data  set  revealed  an  Interesting  structural 
relationship  among  the  kinds  of  matching  tasks  that  have  received  a  great  deal  of  attention  over 
the  last  decade.  A  multidimensional  scaling  of  the  Intercorrelatlons  of  task  latencies  yielded 
a  solution  In  which  tasks  were  arrayed  along  two  orthogonal  slMplexes.  The  first  arrayed  tasks 
by  the  degree  to  which  perceptual  analysis  was  required.  The  second  arrayed  tasks  by  the  depth 
of  *e*ory  search  required  to  perform  Item  comparisons. 

The  theoretical  Importance  of  these  results  stems  from  the  finding  that  Intelligent  behavior 
results  from  the  Interactive  workings  of  somewhat  Independent  processes.  The  applied  Importance 
Is  that  future  selection  and  classification  systems  will  have  to  take  account  of  the  fact  that 
more  than  one  number  will  be  required  to  represent  how  fast  and  accurately  an  Individual 
processes  Information. 
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SLIDE  9 


EXAMPLE  ITEMS 


letter  Identity:  Example  1  Example  2 

Respond  to  alternative  Categoncat  Identity:  Respond  to  alternative 

having  sane  letters  faliino  in  the  sane  category  as  the  stem  word 


(50  or. listed  categories  used) 

SLIDE  tO 

RELIABILITIES,  MEANS  AMD  INTERCORRELATIONS  OF  - 
SELECTED  INFORMATION  PROCESSING  TASKS 


INTERCCPRELATIONS 


TASK 

rll 

MEAN 

RESPONSE 

LATENCY 

SD 

RT 

CRT 

PI 

Nl 

Cl  Ml 

Simple  Reaction  Time 

.08 

.276 

.059 

« 

2-Chcice  Reaction  Time 

.98 

.  414 

.064 

3s 

• 

Physical  Identity 

99 

.655 

.  125 

22 

41 

* 

None  Identity 

.98 

.7  22 

.093 

28 

52 

60 

• 

Category  Identity 

.  °8 

I  139 

21 

43 

49 

72 

• 

Meaning  Identity 

.  PH 

1.695 

428 

19 

34 

36 

5c 

75 

N  •  710 


it 


SLIDE  8 


MDS  SOLUTION  (2  DIM) 

Stress -.094  /T' 

P?  .  *Sim  Matching  (letters) 


D I  Ml:  Number  of  cascaded  processes 
•  2-Choice  RT 


•  Simple  RT 


Categorization 
(letters  &  words) 


•  Seq  Matching,  (letters  & 
words) 


•  Sim  Male  hi  no  (words) 
\y 


T 


SLIDE  6 

DIMENSIONS  OF  INFORMATION  PROCESSING  SPEED 


TASK 

RT_ 

CRT 

RT:  LH 

76 

RH 

92 

CRT:  "L‘"'D" 

75 

"even""odd" 

94 

"pos"”neg" 

93 

'■  vowel'" 'consonant11 

78 

CAT:  words  ( W) 
letters  ( L) 


SEQ  MAT:  W  il) 
W  (2) 
L  (1; 
L  (2) 

SIM  MAT:  W  (1) 
W  <2) 
L  ID 
L  (2) 


F 


4  5 

SEQ  MAT  SIM  MAT/W 


r 

6 


SIM 


64 

87 


72 

80 

100 

81 


85 

87 

71 

54 


FACTOR  INTERCORRELATIONS 


F1 

RT_ 

F2 

CRT 

F3 

CAT 

F4 

SEQ  MAT 

F5  F6 

SIM  MAT/W  SIM  MAT! 

•*-**•*4 

-  •  4 

F1  RT 

... 

F2  CRT 

61 

— 

4 

r3  CAT 

42 

62 

... 

F4  SEQ  MAT 

31 

57 

65 

— 

SIM  MAT/W 

34 

63 

57 

63 

— 

-•  -*i 

F  SIM  MAT/L 

08 

42 

39 

42 

33 

■\  i 

NOTE:  Loadings  <.25  omitted 

Log  time,  correct  items  oMy,  error  feedback  condition 
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Table  3.  Factor  Pattern  Matrix  of  Latency  Scores 
fro*  Reaction  T1m  Tasks:  Study  2  (N  ■  176) 


FI 

F2  F3 

F4 

F5 

F6 

RT 

CRT  CAT 

SQM 

SMMW 

SMMj 

Task 

SRT-LH 

.76 

SRT-RH 

.92 

CRT-LD 

.75 

CRT-EO 

.94 

CRT-PH 

.93 

CRT-VC 

.78 

CAT-W 

.64 

CAT-L 

.87 

SQM-W1 

.72 

SQM-H2 

.80 

SQM-L1 

1.00 

SQM-L2 

.81 

SMM-W1 

.85 

SMH-W2 

.87 

SMM-L1 

.71 

SMM-L2 

.54 

Factor 

Fl-RT 

— 

F2-CRT 

.61 

— 

F3-CAT 

.42 

.62 

F4-SQM 

.31 

.57  .65 

... 

F5-SHMW 

.34 

.63  .57 

.63 

— 

F6-SMM] 

.08 

.42  .37 

.42 

.33 

— 

Note. 

Oblique  solution  with  log  latency; 

bottom  half 

of  table 

Is 

factor  Intercorrelatlons; 

loadings  less  than 

.25  omitted. 

A  match  was  made  on  the  basis  of  either  physical,  name,  category,  or  Meaning  Identity.  Slide 
10  shows  the  reliabilities.  Means,  standard  deviations,  and  Intercorrelatlons  of  tasks.  As  1$ 
typically  the  case  with  reaction  time  tasks,  reliabilities  were  uniformly  high.  Response  latency 
also  Increased  as  a  function  of  the  depth  of  memory  search  from  physical  Identity  (PI) 
Judgements,  Involving  Minimal  memory  search  (because  patterns  could  be  compared  solely  on  the 
basis  of  the  physical  code),  to  meaning  Identity  (Ml)  judgements  Involving  considerable  memory 
search  (presumably  because  word  meanings  can  be  compared  only  after  retrieval  of  considerable 
semantic  feature  sets  for  each  of  the  to-be-compared  words).  Although  not  shown,  stimuli  for  all 
tasks  were  selected  such  that  percent  correct  scores  all  exceeded  90.  The  matrix  In  Slide  9 
suggests  a  simplex  pattern  but  a  multidimensional  scaling  (again  using  ALSCAL)  of  the  data 
yielded  a  more  easily  Interpretable  two  dimensional  solution. 
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Table  2.  List  of  Tests  and  Processing  Components:  Study  2  (N  ■  178) 


Processing  Component 

Tests 

Test  Label 

Respond 

Decide 

Encode  Compare 

Simple  Reaction  Time 

(SRT) 

Left  Hand 

(SRT-LH) 

X 

Right  Hand 

(SRT-RH) 

X 

Choice  Reaction  Time 

(CRT) 

*L*  vs.  "O' 

(CRT-LD) 

X 

X 

■even*  vs.  "odd" 

( CRT— EO ) 

X 

X 

•positive*  vs.  "negative* 

(CRT-PN) 

X 

X 

■vowel*  vs.  ’consonant* 

(CRT-VC) 

X 

X 

Categorization 

(CAT) 

Words 

(CAT-W) 

X 

X 

X 

Letters 

(CAT-L) 

X 

X 

X 

Sequential  Matching 

(SQM) 

Words  (Block  1) 

(SQM-W,) 

X 

X 

X 

X 

Words  (Block  2) 

(SQM-W2) 

X 

X 

X 

X 

Letters  (Block  1) 

(SQM-L,) 

X 

X 

X 

X 

Letters  (Block  2) 

<SQM-L2) 

X 

X 

X 

X 

Simultaneous  Matching 

(SMM) 

Words  (Block  1) 

(SMM-Wj) 

X 

X 

2 

X 

Words  (Block  2) 

(SMM-W2) 

X 

X 

2 

X 

Letters  (Block  1) 

(SMM-Lj) 

X 

X 

2 

X 

Letters  (Block  2) 

(SMM-L2) 

X 

X 

2 

X 

Note.  *X*  means  the  column  component  was 

required 

for  the  particular 

row 

test;  *2*  means  the  component 

had  to  be  executed  twice. 

Number  of  processes  Involved,  from  Simple  Reaction  Time  to  Semantic  Matching  (although  with  a 
slight  mlsorderlng  on  the  simultaneous  versus  sequential  versions  of  the  matching  tasks).  On  the 
second  dimension,  tasks  are  separated  by  content  (word  valences  versus  letter  attributes). 
Toward  the  top  of  the  axis  Is  the  letter  content,  toward  the  bottom  Is  the  word  content,  and 
between  Is  the  mixture  (contents  were  mixed  on  the  first  four  factors).  The  key  point  to  be 
drawn  from  these  analyses  Is  that  although  there  Is  evidence  for  a  general  speed  factor  (observe 
the  positive  manifold  In  the  factor  Intercorrelation  matrix),  there  Is  also  considerable  evidence 
for  more  specific  speed  factors  arrayed  by  both  process  and  content. 


IV.  STUDY  5 

In  the  third  study  (based  on  data  from  Kyllonen,  Tlrre,  i  Chrlstal,  1984),  a  standard 
matching  paradigm  was  used  In  a  coding  analysis  approach  to  examine  differential  facility  In 
accessing  various  memory  codes.  A  series  of  cognitive  tasks  were  administered  to  710  basic 
trainees.  In  addition  to  the  simple  and  choice  reaction  tasks  used  In  the  previous  study,  the 
trainees  were  administered  a  series  of  tasks  that  varied  as  to  match  decision  rule  (Slide  9). 


SLIDE  5 


EMBEDDED  1AS\S 


Reaction  Time 


i  now 


Apprehension 


Response 


Choice  RT 


oositive  | 


n  n 


\ 


Apprehension 


decision 


Response 


Categorization 


!  I 

,  good 
/n  .  \ 


Apprehension 


J  encoding  J 

4 

L 


decision 


Response 


Seq  Mat 

_ |good_  j 

I  lose  j 

! 

^ 


Apprehension 


encoding  (11 


comparison 


decision 


Response 


Sim  Mat 


jqood-lose: 

L'  ' 

/ - * 

ri  n 


|app  recension 

4 


j  encoding 

4 

r_ 


encoding  1 2> 


comparison 


decision 


i 

J 


Response 


Table  3  and  Slide  6  show  the  results  of  an  oblique  factor  analysis  of  the  latency  data  (log 
latency  for  correct  Items  only).  In  which  the  factor  retention  and  rotation  criteria  were  the 
same  as  In  the  previously  discussed  study.  The  top  half  of  Table  3  and  Slide  7  show  the  factor 
loadings  for  the  reaction  time  tests  and  the  bottom  half  of  Table  3  and  Slide  7  show  the  factor 
Intercorrelatlons.  Note  that  the  first  four  factors  are  arrayed  as  process-ensembles 
corresponding  to  the  process  requirements  In  Table  2.  But  factors  5  and  6  split  according  to 
content;  that  Is,  according  to  the  nature  of  the  material  to  be  encoded  (word  valences  [U]  versus 
letter  categories  [L]). 

It  Is  apparent  that  the  factors  are  all  fairly  highly  intercorrelated.  This  analysis  gives 
less  evidence  of  complete  process  Independence  than  did  the  subtraction  analysis  but  Is  ambiguous 
on  the  Issue  of  whether  Individual  differences  variation  is  due  to  process  or  content 
differences.  In  the  case  of  the  simultaneous  matching  task  ( SMM ) ,  there  Is  reliable  Individual 
differences  variance  due  to  content,  but  not  entirely  Independent  of  process  since  r  [F5,  F6]  • 
.33.  Thus,  a  series  of  analyses  of  the  factor  Intercorrelatlon  matrix  were  performed  In  an 
attempt  to  clarify  the  relationships  among  the  factors. 


The  most  readily  Interpretable  analysis  was  a  two-dimensional  scaling  solution,  using  ALSCAL 
(Young  I  lewyckyj,  1979),  for  the  six-variable  matrix  (Slide  8).  This  analysis  orders  the 
cognitive  tasks  along  two  orthogonal  slmplexes.  On  the  first  dimension,  tasks  are  ordered  by  the 


Reasoning,  AR,  and  Mathematics  Knowledge,  MK)  split  their  variance  between  three  factors,  Rj, 
Ns,  and  TK,  Indicating  both  speed  and  level  components  to  these  tests.  The  three 
Verbal/Declarative  Knowledge  tests  In  the  ASVAB  (Word  Knowledge,  WK,  Paragraph  Comprehension,  PC, 
and  General  Science,  GS)  loaded  highest  on  the  Vj  factor.  Indicating  that  primarily  these  have 
level  components.  The  three  technical  knowledge  tests  (Auto-Shop  Information,  AS,  Mechanical 
Comprehension,  MC,  and  Electronics  Information,  El)  primarily  defined  the  TK  factor,  and  the  two 
speeded  tests  formed  a  separate  factor  (CS).  Note  that  In  terms  of  the  factorial  structure 
revealed  In  this  analysis,  the  ASVAB  falls  to  measure  three  abilities:  Reasoning  Speed,  Verbal 
Speed,  and  Numerical  Level,  Further,  most  of  the  ASVAB  tests  are  not  factorial ly  pure;  that  Is, 
they  measure  more  than  one  ability.  Further  validation  studies  could  Indicate  whether  this 
represents  a  practical  concern  In  the  ASVAB. 

Because  oblique  rotation  was  applied  to  the  original  factor  pattern  matrix,  the  first-order 
factors  were  free  to  correlate  and  this  enabled  the  analysis  of  a  second-order  solution.  This 
analysis  (not  shown)  Indicated  that  uncorrelated  (r  »  -.05)  general  speed  (£j)  and  general 
level  (gj)  factors  could  be  Identified  at  the  second  order. 

Finally,  an  orthogonal  rotation  of  the  original  factor  pattern  matrix  was  performed  using  the 
Varlmax  criterion.  A  great  deal  of  emphasis  was  not  placed  on  this  solution  because  It  failed  to 
achieve  what  Thurstone  has  called  "simple  structure."  Yet,  It  was  Interesting  that  scores  that 
defined  separate  speed  factors  In  the  oblique  solution  essentially  collapsed  Into  a  single  speed 
factor  In  the  orthogonal  solution.  Thus,  regardless  of  the  factor  rotation  method,  a  general 
speed  factor  Is  defined:  If  orthogonal  rotation  Is  employed,  the  speed  factor  is  first  order;  If 
oblique  rotation  Is  employed,  the  speed  factor  Is  second  order. 

In  sum,  analysis  of  correctness  and  latency  scores  from  a  broad  variety  of  cognitive  tests 
suggested  the  existence  of  both  primary  and  secondary  speed  and  level  factors.  This  suggests 
that  what  have  been  known  as  primary  mental  abilities  actually  Include  separate  speed  and  level 
components.  The  speed  component  of  three  primary  ab111t1es--reasonlng,  verbal,  and 
numerical— are  separable  yet  somewhat  correlated,  and  thus,  they  form  a  general  speed  factor. 


III.  STUDY  2 

In  the  second  study  (based  on  data  from  Kyllonen,  1984b),  using  a  stage-analysis  approach, 
178  basic  trainees  were  administered  a  series  of  cognitive  tasks  designed  to  yield  Individual 
parameter  estimates  of  encoding,  comparison,  decision,  and  response-execution  speed.  This  was 
accomplished  through  the  use  of  a  subtraction  method:  A  series  of  tasks  was  created  such  that 
they  could  be  ordered  from  simple  to  complex  In  terms  of  processing  requirements  (see  Slide  5). 
The  most  complex  of  the  tasks,  a  simultaneous  semantic  comparison  task,  required  the  execution  of 
all  the  Information  processing  steps,  and  successively  simpler  tasks  were  created  by 
systematically  eliminating  one  step.  In  this  way,  the  parameters,  which  represented  the  duration 
of  the  various  processing  steps,  could  be  estimated  by  taking  the  difference  between  response 
time  (T)  on  each  of  the  tasks  and  response  time  on  the  next  simpler  task  (Tj,  -  T^.j). 
Reliabilities  of  the  four  parameters  estimated  In  this  fashion  were  uniformly  high  (all  exceeded 
.80),  But  Interestingly,  none  of  the  between-parameter  correlations  were  significantly  different 
from  zero.  If  additivity  of  processing  stages  can  be  assumed  In  this  paradigm,  then  the  lack  of 
significant  correlation  among  parameters  can  be  taken  to  Indicate  that  four  Independent 
dimensions  of  processing  speed  were  present  In  this  study. 

However,  the  additivity  assumption  for  these  kinds  of  tasks  has  been  questioned  (Donaldson, 
1963;  McClelland,  1979).  Thus,  an  alternative  analysis  of  dimensionality  was  also  performed  on 
the  data.  The  variables  are  five  sets  of  reaction  time  tasks  listed  with  their  processing 
component  description  In  Table  2. 
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FACTOR  PATTERN  MATRIX 
(cont ,  N  *  508,  Study  1) 


Arith  Reason  (AR) 

Math  Know  (MK) 

Word  Know  (WK) 

Para  Comp  (PC) 

Gen  Science  (GS) 

Auto-Shop  (AS) 

Mech  Comp  (MC) 

Elec  Info  (El) 

Code  Speed  (CS) 

Num  Ops  (NO) 

The  Verbal/Declarative  Knowledge  Level  Factor  (Vj)  was  loaded  by  the  percentage  of  correct 
scores  from  the  Fact  verification  and  Synonym  recognition  tasks,  and  the  corresponding  Verbal 
Retrieval  Speed  factor  (Vs)  was  loaded  by  the  speed  scores  from  these  two  tests. 

The  Numerical  Level  factor  (Nj )  was  loaded  by  percent  correct  scores  of  tasks  from  both  the 
Simple-  and  Complex-Numerical  categories,  and  the  latency  scores  from  these  same  tasks  defined  a 
Numerlcal/Computatlon  Speed  (Ns)  factor. 

The  final  two  factors.  Technical  Knowledge  (TK)  and  Clerical  Speed  (CS),  were  defined 
exclusively  by  the  total  scores  from  certain  paper-and-pencll  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB)  tests  (DoD,  1964) .  Although  It  might  seem  surprising  that  the  ASVAB  Numerical 
Operations  (NO)  test  did  not  load  on  the  Nj  factor,  a  previous  analysis  of  this  task  (Kyllonen, 
1984a)  showed  that  only  a  small  fraction  (13%)  of  the  time  examinees  spend  on  this  task  is 
devoted  to  actual  numerical  computations  and  only  a  small  percentage  of  the  total  score  variation 
on  this  task  (201)  is  due  to  computational  facility.  The  remainder  of  the  time  Is  devoted  to 
finding  the  answer  and  marking  the  answer  sheet,  and  thus,  the  test  measures  primarily  clerical 
not  computational  skills. 

Although  the  purpose  of  this  analysis  was  to  determine  whether  speed  factors  could  be 
Identified,  an  Incidental  benefit  (apparent  from  Table  1)  was  that  the  factorial  composition  of 
the  ASVAB  tests  Is  suggested.  The  two  Quantitative-Reasoning  tests  from  the  ASVAB  (Arithmetic 
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FACTOR  PATTERN  MATRIX 
(N  *  508,  Study  1) 


Analogies 
No.  Sets 
Ltr  Sets 
3-Term 
Sent-Pict 
Trait  Levels 
Paired-Assoc 
Mem  Span 

Analogies  (L) 

No.  Sets  CL) 

Ltr  Sets  (L) 

3-Term  (L) 

Sent-Pict  (U 
Trait  Levels  (L) 
Paired-Assoc  < L) 
Mem  Span  <L) 

Fact  Verify 
Synonym  Match 

Fact  Verify  (L> 
Synonym  Match  (L) 


Number  Facts 
Arith  Tracking 
Symbol  Arith  I 
Symbol  Arith  1 1  '  + 

Sun-Tue  Addition  + 


Number  Facts  (D 
Arith  Tracking  (L) 

Symbol  Arith  I  (L) 

Symbol  Arith  1 1  iL)  + 

Sun-Tue  Addition  'D 
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